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FOREWORD 


This  study  was  performed  by  Dr.  Sze-Tsen  Hu,  Professor  of  Mathematics,  University 
of  California  at  Los  Angeles,  while  acting  as  consultant  to  the  Electronic  Sciences 
Laboratory,  Lockheed  Missiles  &  Space  Company,  Sunnyvale,  California. 
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ABSTRACT 


This  report  describes  an  algorithm  for  applying  the  dual,  simplex  method  in  linear 
programming  to  the  problem  of  determining  whether  or  not  a  given  switching  function 
is  linearly  separable.  Further,  where  separability  is  possible,  a  description  is 
given  of  the  application  of  the  dual  simplex  method  to  finding  the  most  economic  sys¬ 
tem  of  weights  and  threshold. 


A  detailed  elementary  exposition  of  the  dual  simplex  method  is  given  in  Sections  2 
through  4.  A  completely  worked  out  illustrative  numerical  example  is  presented  in 
Section  5.  hi  Sections  6  through  8,  the  dual  simplex  method  is  applied  to  the  problem 
of  determining  minimal  weights  and  threshold;  this  is  illustrated  by  a  numerical 
example  which  reduces  to  the  example  given  in  Section  5 . 
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Section  1 
INTRODUCTION 


Linear  programming  was  first  applied  to  the  general  synthesis  problem  of  linear 
separability  of  switching  functions  by  R.  C.  Minnick  (Ref.  1).  Using  Minnick's 

n 

method  for  a  switching  function  of  n  variables,  it  becomes  necessary  to  solve  2 

equations  in  2(n  +  1  +  2n)  nonnegative  variables  in  such  a  way  that  the  cost  function 

will  be  minimized  (Ref.  1,  p.  11).  For  n  =  7  ,  which  is  the  lowest  dimension  of 

the  problem  not  yet  solved,  it  is  necessary  to  solve  128  equations  in  272  nonnegative 

128 

variables  for  each  of  the  2  switching  functions  of  seven  variables.  This  is  by 
far  too  large  a  task  for  even  the  best  electronic  computers  to  accomplish. 

In  a  joint  paper  of  S.  Muroga,  I .  Toda,  and  S.  Takasu  (Ref.  2),  which  appeared  two 
months  following  Ref.  1,  linear  programming  was  also  applied  to  the  general  synthesis 
problem.  Unlike  Minnick,  the  authors  of  Ref.  2  introduced  a  reduction  process  which 
reduced  the  number  of  inequalities  by  applying  the  deletion  law  in  Boolean  algebra. 

This  method  is  considerably  simpler  than  that  of  Minnick  but  not  simple  enough  for 
actual  computation. 

In  an  earlier  report  by  the  author  (Ref.  3),  linear  programming  was  applied  to  the 
Willis  synthesis  method  (Ref.  4)  for  finding  canonical  separating  systems;  the 
canonical  partial  order  was  fully  used  and,  hence,  the  number  of  inequalities  reduced 
to  a  minimum.  The  solution  of  the  resulting  system  of  inequalities  for  any  given 
regular  switching  function  of  n  variables  depends  completely  on  that  of  a  system  of 
n  +  2  linear  equations  in  accordance  with  a  well-known  theorem  on  linear  inequalities. 
The  problem  of  solving  this  system  of  n  +  2  linear  equations  is  made  into  a  canonical 
minimum  problem  of  linear  programming  by  introducing  one  more  variable.  Then, 
the  usual  simplex  method  is  applied  to  this  canonical  minimum  problem. 
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In  another  of  the  author's  reports  (Ref.  5),  the  problem  of  finding  the  most  economic 
separating  systems  was  formulated  in  the  form  of  a  standard  minimum  problem  of 
linear  programming.  It  was  proved  in  Ref.  5  that  this  standard  minimum  problem 
has  optimal  solutions  if  and  only  if  it  is  feasible.  However,  the  usual  method  in 
linear  programming  for  solving  a  standard  minimum  problem  consists  of  two  major 
steps:  first,  one  must  determine  whether  or  not  the  problem  is  feasible  and,  if  so, 
find  a  feasible  solution  of  the  problem;  second,  using  the  feasible  solution  obtained 
in  the  first  step,  one  can  find  an  optimal  solution  of  the  problem  by  means  of  the 
usual  simplex  method.  The  first  step  can  be  accomplished  by  the  method  given  in 
Ref.  3  which  involves  another  application  of  the  simplex  method.  It  appears  that  one 
has  to  use  the  simplex  method  twice  to  get  a  set  of  minimal  weights  and  threshold. 
Fortunately,  this  apparent  complication  is  by  no  means  inevitable.  In  fact,  in  a 
recent  report  by  the  author  (Ref.  6),  an  algorithm  was  described  for  solving  this 
problem  by  applying  the  usual  simplex  method  on  its  dual  maximum  problem. 

The  objective  of  the  present  report  is  to  give  a  simpler  direct  method  of  solving  the 
minimization  problem  by  making  use  of  the  dual  simplex  method  of  C.  E.  Lemke 
(Ref.  7).  The  minimization  problem  is  always  dually  feasible  no  matter  whether  the 
given  regular  switching  function  is  linearly  separable  or  not.  Hence,  the  problem 
can  be  solved  by  applying  the  dual  simplex  once,  not  twice. 

For  the  convenience  of  the  reader,  a  detailed  exposition  of  the  dual  simplex  method 
in  the  form  suitable  for  our  application  is  given  in  Sections  2  through  4.  An  illus¬ 
trative  numerical  example  is  presented  in  Section  5.  In  Sections  6  and  7,  we  will 
review  briefly  the  preliminaries  and  formulate  the  synthesis  and  minimization 
problem.  The  solution  of  the  problem  by  means  of  the  dual  simplex  method  is  given 
and  illustrated  in  Section  8 . 
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Section  2 

STANDARD  PROBLEM  IN  LINEAR  PROGRAMMING 


A  standard  problem  in  linear  programming  is  to  find  nonnegative  real  numbers  which 
minimize  (or  maximize)  a  given  linear  function  subject  to  a  given  system  of  linear  in¬ 
equalities.  Since  a  maximum  problem  is  reduced  to  a  minimum  problem  simply  by 
multiplying  the  given  linear  function  with  -1,  we  will  describe  and  study  the  standard 
minimum  problem  only. 

For  this  purpose,  let  us  consider  a  given  linear  function 

q 

a  +  Y' a  .  t.  (2.1) 

o,o  Z-/  °.l  J 

j=l 

of  q  variables  t^,  •••,  t^,  where  a0  Q>  a0  *  ' '  >  aD  q  are  given  real  numbers . 
On  the  other  hand,  let 

q 

a.  H-V' a.  .  t.  >  0  (2.2) 

x,o  x,  j  j  = 

j=l 

where  i  =  1,  2,  •  •  • ,  p,  be  a  given  system  of  p  inequalities  in  the  same  variables 
t.. ,  •  •  • ,  t  with  given  real  coefficients  a.  .  and  constant  terms  a.  .  Then,  the 

1  q  b  i,3  i,o 

standard  minimum  problem  in  linear  programming  is  the  problem  of  finding  nonnega¬ 
tive  real  numbers  t^,  •  •  • ,  t  which  minimize  the  given  linear  function  (2. 1)  subject 
to  the  system  (2.2)  of  p  linear  inequalities. 


Now,  let  y  denote  the  given  linear  function  (2. 1)  and  let  x.  ,  (i  =  1,  2,  •  •  • ,  p)  , 
denote  the  linear  function  on  the  left  side  of  the  inequality  (2.2).  Consider 
y,  Xp  •  •  • ,  Xp  also  as  variables.  Then,  the  standard  minimum  problem  described 
above  can  be  restated  as  follows: 
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Problem:  Find  the  minimum  value  of  the  variable  y  subject  to  the  following  p  +  1 
linear  equations: 


q 

y  =  a  +7  a  .  t. 
J  o,o  o,j  j 

j=l 

q 

x.  =  a.  +  >  a.  .  t. 

1  1,0  i,j  j 

j=l 

where  i  =  1,  2,  •  •  ■ ,  p  ,  and  the  condition  that 


xi  ^  (i  =  1,  2,  •  •  • ,  p)  , 

t  £  0,  (j  =  1,  2,  •  •  • ,  q)  . 


Let  A  denote  the  p  +  1  by  q  +  1  matrix 


where  0  <;  i  <  p  and  0  i  j  |  q  . 


(2.3) 


(2.4) 


(2.5) 


(2.6) 


(2.7) 


A  column  /?  in  A  is  said  to  be  (lexicographically)  positive, 

P  >  0 

provided  that  the  first  nonzero  entry  of  p  ,  counting  from  top  down,  is  positive.  A 
column  p  in  A  is  said  to  be  (lexicographically)  greater  than  another  column  y  in 
A  provided  that 


P  -  y  >  0  . 

Hereafter,  we  will  omit  the  word  "lexicographically"  when  there  is  no  danger  of 
misunderstanding. 
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The  matrix  A  is  said  to  be  dually  feasible  in  ease  the  q  columns 


a. 

1 


%f 


P>J 


)* 


where  j  =  1,  2,  •••,  q.  Note  that  the  leading  column  Qq  in  A  is  not  required  to 
be  positive  or  zero  for  the  dual  feasibility  of  A  .  In  particular,  A  is  dually  feasible 
if 


aQ  j  >  0  ,  (j  =  1,  2,  q)  . 

If  the  matrix  A  is  dually  feasible,  then  our  standard  minimum  problem  is  also  said 
to  be  dually  feasible. 


A  trial  solution  of  our  problem  is  obtained  by  setting 

tj  =  0  ,  (j  =  1,  2,  •  •  • ,  q) 

in  the  p  +  1  linear  equations  (2.  3)  and  (2.4).  Hence,  the  trial  solution  of  our  problem 
is  given  by 


x.  -=  a.j0  ,  (i=  1,  2,  •••,  p) 

t.  =  0  ,  (j  =  1,  2,  •  •  • ,  q)  . 

If  A  is  dually  feasible,  then  y  =  a0  0  is  its  minimum  value  for  all  nonnegative  values 
of  the  q  variables  t.  ,  (j  =  1,  2,  •••,  q).  However,  unless 

ai  0  ^  0  ,  (i  =  1,  2,  •••,  p)  , 

the  trial  solution  obtained  above  is  not  a  solution  of  our  problem  because  the  condition 
(2.  5)  is  not  satisfied.  In  fact,  we  have  the  following: 
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Theorem  2.1.  The  trial  solution 


where  i  -  1,  2,  •  ■  • ,  p  and  j  =  1,  2,  •  •  • ,  q,  is  an  optimal  solution  of  the  standard 
minimum  problem  if  and  only  if  A  is  dually  feasible  and 

ai,o  =  0  »  (i=  1,  2,  p)  . 
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Section  3 

DUAL  SIMPLEX  METHOD 


The  dual  simplex  method  for  a  dually  feasible,  standard  minimum  problem  with 
matrix 


(3. 1)  &  (2.7) 


where  0  <  i  <  p  and  0  <  j  <  q  ,  is  a  finite  process  of  transforming  the  given  problem 
into  equivalent  standard  minimum  problems  with  matrices 


respectively  described  so  that  the  trial  solution  of  the  last  problem  with  matrix 
is  an  optimal  solution  of  the  problem. 


To  insure  that  all  variables  remain  nonnegative  in  the  final  trial  solution,  we  adjoin 
to  the  system  (2.3)  and  (2.4)  of  linear  equations  in  Section  2  the  identical  equations 

t.  =t.  ,  (j  =  1,  2,  •••,  q)  .  (3.2) 

The  coefficients  and  constant  terms  of  the  right  members  of  the  system  (2.3),  (2.4) 
and  (3.2)  form  the  following  matrix: 
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a  , 

o,  o  ’ 

ao,  1  ’ 

ao,  2  » 

9 

a 

o,q 

4 

1,0  ’ 

al,l  * 

al,  2  ’ 

*  *  9 

a., 

i,q 

ap,0  ’ 

P,1  ’ 

ap,2  ’ 

9 

a 

p>q 

0  , 

1 , 

0  , 

9 

0 

0  , 

0  , 

1  , 

9 

0 

II  o  ,  o  ,  o  ,  ,  1 

In  more  compact  notation,  we  have 


Ao 


A 

0  I 


(3.3) 


where  A  denotes  the  p  +  1  by  q  +  1  matrix  (3.1),  0  denotes  the  q  by  1  matrix 
which  consists  of  q  zeroes,  and  I  denotes  the  q  by  q  unit  matrix.  Therefore,  A° 
is  a  p  +  q+1  by  q  +  1  matrix.  Let  us  label  the  rows  of  Aq  by  the  integers 


i  =  0,  1,  • 
Denote  by 


,  p  +  q  and  the  columns  of  Aq  by  the  integers  j  =  0,  1, 


,  q 


a.  .  , 
LI 


(0  <  i  <  p  +  q,  0  <  j  <  q) 


the  element  of  A  at  the  i-th  row  and  the  i-th  column, 
o  J 


On  the  left  member  of  the  identical  equation  (3.2),  let  us  use  the  symbol 

Vr 

for  the  variable  t.  .  Then,  our  standard  minimum  problem  is  equivalent  to  the 
1  o 

standard  minimum  problem  with  matrix  A  which  is  to  find  the  minimum  value  of 
the  variable  y  subject  to  the  following  p  +  q+1  linear  equations: 
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TL 

y  =  a  +  >  a  .  t. 
0,0  o,j  j 


j=l 


x.  =  a.  +  7  a.  .  t. 

1  1,0  1,J  j 

j=l 

where  i  =  1,  2,  •  •  • ,  p  +  q  and  the  condition  that 


>  °  , 


(i  =  1,  2,  •  •  • ,  p  +  q) 


(3.4) 


(3.5) 


(3.6) 


Since  the  given  problem  A  is  assumed  to  be  dually  feasible  and  since  A  is  obtained 
by  adjoining  q  nonnegative  rows  to  A  ,  it  is  clear  that  Aq  is  also  dually  feasible. 

The  variables  tp  t2,  •  •  •,  tq  on  the  right  members  of  (3.4)  and  (3.5)  are  tradition¬ 
ally  called  the  nonbasic  variables  of  the  problem  Aq  .  By  the  definition  of  the  new 
variables  xp+  .  ,  (1  £  j  £  q)  ,  introduced  above,  we  know  that  tine  nonbasic  variables 
V  • 1  1  >  4q  als°  appear  on  the  left  members  of  (3. 5)  as  q  of  the  p  +  q  variables 
xl’  "  xp  +  q  •  Because  of  this  fact,  the  condition  (3.6)  implies  that  t.  >  0  for 

every  j  =  1,  2,  •  •  • ,  q  . 

Now,  let  k  be  a  given  positive  integer  and  assume  that  our  standard  minimum  problem 
A  has  been  reduced  to  an  equivalent  standard  minimum  problem  with  matrix 


(0  £  i  £  p  +  q,  0  £  j  £  q),  which  is  to  find  the  minimum  value  of  the  variable  y 
subject  to  the  following  p  +  q  +  1  linear  equations: 


y  =  b 


o,  o 


-E1 

i=i 


.  u. 
,3  3 


(3.7) 
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1 


q 


X. 

1 


b 

i. 


+y  b. .  u. 

L-J  bJ  J 

j=l 


where  i  =  1,  2,  •••,  p  -i-  q  and  the  condition 


(3.8) 


x.  ^  0  ,  <i=  1,  2,  •••,  p  +  q)  .  (3.9) 

Furthermore,  we  assume  that  ^  is  dually  feasible  and  that  the  nonbasic  variables 
Ul’  '  ‘  '  ,uq  52.  right  members  of  (3 . 7)  and  (3 . 8)  also  appear  on  the  left  members  of 

(3.8)  as  q  of  (die  p  +  q  variables  Xp  •••,  xp  +  q  ■  Because  of  this,  the  condition 

(3.9)  implies  that  m  >  0  for  every  j  =  1,  2,  •••,  q  . 


Kb-  >0  for  every  i  =  1,  2,  •  •  • ,  P  +  q,  then  the  trial  solution 
x,  o  — 

y=b0)0  (3-10) 

x,  =  b  (i=  1,  2,  •••,  p  +  q)  ,  (3.11) 

Jt  JL  j  U 

is  an  optimal  solution  of  the  standard  minimum  problem  with  matrix  A]f  _  ,  according 
to  Theorem  2. 1.  Since  the  standai-d  minimum  problem  with  matrix  A^_  ^  is  equiva¬ 
lent  to  our  original  standard  minimum  problem  with  matrix  A  ,  it  follows  that  the 
trial  solution  given  by  (3. 10)  and  (3. 11)  is  also  an  optimal  solution  of  our  original 
problem.  In  this  case,  we  have  obtained  an  optimal  solution  of  our  original  problem 
and  hence  the  problem  is  solved  affirmatively. 


Now  let  us  assume  that  A,  ,  is  dually  feasible  but  not  all  of  the  b.  's  , 

k  - 1  J  l,  o 

(1  <  i  <  p  +  q),  are  nonnegative.  Choose  some  i  =  i  ,  (1  ^  iQ  ^  p  +  q)  ,  with 

b.  <  0  .  (3.12) 

i  o  = 

o, 


Consider  the  other  elements  bio  j  of  the  row  in  A(_  _  1  labelled  by  iQ  .  If 

bi  j  <  0  ,  (j  =  1,  2,  •••,  q)  (3.13) 


I 

\ 

J 
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then  the  negative  value  =  bjQ  0  is  the  maximal  possible  value  of  xiQ  subject 
to  the  condition 

Uj  >  0  ,  (j  =  1.  2,  •••,  q)  .  (3.14) 

In  this  case,  the  standard  minimum  problem  with  matrix  has  no  optimal  solu¬ 

tion;  in  fact,  the  system  (3.8)  of  p  +  q  linear  equations  has  no  nonnegative  solution  in 
xl’  ‘  ‘  ’  >  xp  +  q  ‘  Stnce  the  standard  minimum  problem  with  matrix  ^  is  equiva¬ 
lent  to  our  original  standard  minimum  problem  with  matrix  A  ,  it  follows  that  our 
original  problem  has  no  optimal  solution  if  there  exists  an  integer  i  such  that 
(3. 12)  and  (3. 13)  both  hold .  In  this  case,  the  system  (2.4)  of  p  linear  equations  fails 

to  have  nonnegative  solution  in  x.,  -  •  • ,  x  and  t. ,  •  •  • ,  t.  .  Hence,  the  problem  is 

P  1 

solved  negatively  in  this  case. 


Next,  let  us  assume  that  (3. 13)  is  false.  Consider  the  columns  P  j  of  A^  _  j  with 


b.  .  >  0  (3.15) 

V 


and  select  from  these  a  column  /T  of  A^  1  such  that 


(3. 16) 


in  the  lexicographical  order  defined  in  Section  2  for  all  j  satisfying  (3. 15).  In  par¬ 
ticular,  we  have 


b.  .  >  0  . 

VJo 


(3.17) 


The  fundamental  operation  used  to  derive  A^  from  Aj_  _  ^  is  the  Garissian  elimin¬ 
ation,  traditionally  called  pivoting  (on  rows)  in  the  theory  of  linear  programming. 

Once  the  integers  i  and  j  have  been  chosen  as  above,  the  element  b.-  t  is 
0  °  o’  Jo 

called  the  pivot  element. 
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The  Garissian  elimination  with  b|  i  as  the  pivot  element  can  be  described  as 

o’  Jo 

follows.  We  first  solve  the  i„-th  equation  of  the  system  (3. 8)  for  u<  in  terms  of 

Jo 

X:  and  the  remaining  u.'s;  in  other  words,  we  write  the  i  -th  equation  of  (3.8)  in 
m  3  o 

the  following  form: 


u.  =r - 

3  b.  . 
0  i  >3 


o  "o 


1  ,o 
o’ 


Yb.  ,U.  +  X.\. 
3^3„  / 


(3.18) 


Then  substitute  m  in  each  equation  of  (3.7)  and  (3.8)  by  the  right  member  of  (3.18). 
Jo 

■ ,  x  are  expressed  as  linear  functions  of  the 


Thus,  the  variables  y  and  x^, 
q  variables 


u 


1’ 


u. 

3 


o 


1 


U.  ,  H  , 
3  +1 
Jo 


u 


q 


For  the  sake  of  neatness,  let  us  denote  these  q  variables  by  v- ,  •  •  • ,  v  ;  in  other 

q 

words,  let 


v 


3 


(if  3  *  J0) 

(if  3  =  .i0)  • 


The  result  of  the  Garissian  elimination  with  b<  ,  as  pivot  element  is  that  the 

V^o 

equations  (3.7)  find  (3.8)  are  transformed  into  an  equivalent  system  consisting  of 
p  +  q  +  1  linear  equations  of  the  following  form: 


y 


xi 


CL 


vj 


i=i 


where  i  -  1,  2,  •  •  • ,  p  +  q  . 


(3.19) 


(3.20) 
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Since  the  new  non 'basic  variables  v. 


V1’ 


■  •  ,  v  are  the  variables  uv  in  _lt  x,  , 
,  u^  ,  they  also  appear  on  the  left  members  of  (3.20)  as  q  of  the  p  +  q 


variables  x. 


p+q 


Let 


A 


k 


II 


(0  <  i  <s  p  +  q,  0  <  j  .<  q)  denote  the  matrix  of  constant  terms  and  coefficients  on 
the  right  members  of  (3. 19)  and  (3.20). 


Since  (3.  19)  and  (3.20)  are  derived  by  substituting  (3. 18)  into  (3.7)  and  (3.8),  the  ele¬ 
ments  c.  .  of  A|,  can  be  easily  computed  from  those  of  A^_^  as  follows:  For  each 
j  =  0,  1,  •  •  • ,  q  ,  let  P  .  and  y .  denote  the  j-th  column  in  A,  ,  and  A,  respective- 
ly,  that  is  to  say, 

“  (bo. i’  bi,  j’  '  bp+q,j) 
rj  _(co.j’  ciJ’  ’  cp+q,j) 

Then,  one  can  easily  verify  that 


r .  = 

i 


b. 

VJ 

o 

o  o 


b.  .  ’ 

i  ,3  Jo 
O  0 


(if  j  *  j0) 


(if  j  =  y 


In  words,  the  matrix  A^  can  be  obtained  from  the  matrix  A^_^  as  follows:  First, 

divide  the  j  -th  column  (3 :  of  A,  ,  by  the  pivot  element  b;  :  ;  second,  sub- 
o  J0  K  i  o’Jo 

tract  from  every  other  column  13.,  j  ^  jQ  ,  this  new  jQ-th  column  multiplied  by 

bj  i  .  The  result  is  the  matrix  A,  . 

Jq,]  k 


Note  that,  in  the  resulting  matrix  A,  ,  we  have  cj  4  =  1  and  m  ,  =  0  for  every 

K  O’  J0  0,J 

j  j  .  Therefore,  the  second  step  in  the  preceding  paragraph  can  be  interpreted 
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as  to  subtract  from  every  column  /3  ,  j  ^  jQ  ,  a  multiple  of  the  new  j0~th  column 
so  that  its  element  c*  4  in  the  i  -th  row  vanishes. 

V3  ° 

Having  determined  the  columns  of  the  new  matrix  ,  we  will  prove  that  this  matrix 
is  still  dually  feasible.  For  this  purpose,  let  j  be  an  arbitrary  integer  satisfying 
1  <  j  <  q  .  We  will  prove  that  Yj  >  0  lexicographically. 


To  do  this,  let  us  first  consider  the  case  j  =  j  .  In  this  case,  since 


>  0  , 


b.  .  >  0 
1o’  3o 


by  the  dual  feasibility  of  A.  _  ^  and  {3. 17),  we  have 

“b^r  ('’j  y 

Jo  1,1  Jo 
o’  Jo 


Next,  assume  that  j  ^  j  *  Then  we  have 


v 

Tj  "  bi  ,J  \ 
o’ Jo 


(3.21) 


=  b.  . 


ft. 

J  o 


V3  \bi  ,j  bi  ,i  r 

'  o  J  O'O, 


(3.22) 


If  b-  .  <  0  ,  then  it  follows  from  (3.21)  that 
l  ,  1  — 
o’ J 

y .  >  ft  .  >  0  . 

1 J  =  J  = 

IE  b.-  4  >  0  ,  then  (3.16)  holds.  Hence,  by  (3.22),  we  have 

o’J 

y.  >  0  . 

3  = 


This  completes  the  proof  that  A^  is  dually  feasible. 
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Thus,  our  given  dually  feasible  standard  minimum  problem  with  matrix  A  has  been 
reduced  to  an  equivalent  dually  feasible  minimum  problem  with  matrix  =  j|  ^  jj, 

(0  <  i  <  p  +  q,  0  <  j  <  q) ,  which  is  to  find  the  minimum  value  of  the  variable  y  subject 
to  the  p  +  q  +  1  linear  equations  (3. 19)  and  (3.  20)  and  the  condition  (3.9).  Since  the 
new  nonbasic  variables  v,,  •  •  •,  v  also  appear  on  the  left  members  of  (3.20)  as  q 
of  the  p  +  q  variables  x^,  •••,  x^  +  ,  we  have 

v.  >  0  ,  (j  =  1,  2,  •••,  q)  .  (3.23) 

This  completes  the  inductive  construction  of  the  sequence  of  equivalent  dually  feasible 
minimum  problems  with  matrices 

Aqi  A^_^,  A^.,  •••  .  (3.24) 


It  remains  to  prove  the  finiteness  of  the  sequence  (3.24).  For  this  purpose,  let  us 
consider  the  leading  column  in  the  matrix  A^  .  By  the  dual  feasibility  of 
A^. and  (3.17),  we  have 


i3  .  >  0  . 

Jo 

On  the  other  hand,  it  follows  from  (3. 12)  and  (3. 17)  that 


By  (3.25)  and  (3.26),  we  have 


o’  Jo 


>  0  . 


r 

o 


bi,o 

-r-2 —  p.  >  p 

bi  ,i  Jo  ° 
o’  -to 


(3.25) 


(3.26) 


(3.27) 


Hence,  as  k  increases,  the  leading  column  in  A^  increases  strictly  in  the  lexi¬ 
cographical  order.  Since  there  is  only  a  finite  number  of  possible  sets  of  q  non¬ 
basic  variables  chosen  from  the  p  +  q  variables  x^,  •••,  xp  +  q  and  any  choice 
uniquely  determines  the  leading  column,  the  process  must  stop  at  some  A^  . 
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v 


This  can  happen  either  if  there  is  no  negative  element  in  the  leading  column  y  ^  of 
A|t  ,  or  if  there  is  a  negative  element 


in  the  leading  column  y  q  of  but  no  positive  element  in  the  iQ-th  row  of  A^  ; 
i.e., 

ci  i  ^  0  -  (0  <  j  <  q)  . 

0>  J 

In  the  first  case,  the  trial  solution 

V  =  c 
y  0,  o 

xi  =  ci)  o  >  (1  <  i  <  p  +  q) 

of  the  problem  with  matrix  A^  is  an  optimal  solution  of  our  given  standard  minimum 
problem  with  matrix  A  .  Hence,  in  this  case,  the  problem  is  solved  affirmatively. 

In  the  second  case,  the  negative  value  Cj  f  o  is  the  largest  value  of  the  variable 

o 

Xj  and  consequently  our  standard  minimum  problem  with  matrix  A  has  no  nonnegative 
o 

solution.  Hence,  in  this  case,  the  problem  is  solved  negatively. 
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Section  4 

DUAL  SIMPLEX  TABLEAUX 


For  computational  purpose,  the  dual  simplex  method,  which  is  described  and  proved 
in  Section  3,  can  be  worked  exclusively  on  the  matrices  involved. 

The  given  standard  minimum  problem  is  represented  by  the  matrix 
A=j|ai  ,||  ,  {0  ^  i  £  p,  0  <  j  <j  q)  . 

The  dual  simplex  method  is  essentially  a  finite  process  of  deriving  from  A  a  sequence 
of  p+q+1  by  q+1  matrices: 


The  initial  matrix  Aq  is  given  by 


A 


o 


as  described  in  Section  3.  In  the  actual  computation,  we  will  write  Aq  in  the  form 
of  the  following  tableau  Tq  which  will  be  called  the  initial  tableau: 
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Const. 

*1 

*2 

.... 

t 

q 

y 

a 

0,  0 

ao,l 

a°,  2 

.... 

a 

o,  q 

xi 

a., 

1,0 

al,l 

al,  2 

.... 

a1 

l,q 

X2 

a0 

2,o 

a2,l 

a2,  2 

.... 

a0 

2,q 

. 

j 

; 

• 

; 

XP 

a 

p,o 

^,1 

a  „ 

p,2 

.... 

a 

P.  q 

Xp+1 

0 

1 

0 

.... 

0 

Xp+  2 

0 

0 

1 

.... 

0 

• 

; 

• 

0 

xp+q 

0 

0 

0 

.... 

1 

For  each  k  =  1,  2,  •  •  • ,  r  ,  the  matrix  is  represented  by  a  similar  tableau 
in  which  the  columns  are  headed  by  const. ,  v^,  v2,  •  •  • ,  v  ,  the  new  nonbasic 
variables.  The  operation  of  deriving  from  1  is  described  as  follows: 

Consider  the  tableau  Tj  _  ^  which  has  been  constructed  by  the  preceding  step: 


Const. 

ui 

U2 

.... 

- 

q 

y 

b 

0,  0 

bo,l 

b  _ 

0,  ^ 

.... 

b0,q 

xi 

b1 

1,0 

bl,  1 

bl,2 

.... 

bl’q 

X2 

b0 

2,o 

b2,l 

b2,  2 

.... 

b2,q 

• 

• 

• 

• 

; 

*P 

b 

p,o 

b  , 

P,l 

b  „ 

P>  2 

b 

p.q 

Xp+  1 

b  ,  , 

P+1,0 

bp+l,l 

bp+l,  2 

.... 

b 

p+ 1,  q 

X 

p+2 

bp  +  2 ,  o 

bp  +  2,l 

bp+  2,  2 

.... 

bp+2,q 

. 

* 

* 

‘ 

• 

Xp  +  q 

b  , 

p+q>  o 

bp  +  q,l 

bp+q,  2 

bP+q,q 
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If  the  constant  column  in  T.  .  contains  no  negative  entry,  then  it  gives  an  optimal 

K  —  A 

solution  of  the  given  standard  minimum  problem.  Precisely,  the  minimum  value  of 
the  linear  function 


is  b  reached  when 
o,  o 


V  =  a  +  \  a  .  t. 
J  0,0  0,]  ] 

j=l 


t.  =  x  ,  .  =  b  .  . 

1  P  +  J  P+J,o 


for  every  j  =  1,  2,  . . . ,  q  . 


Otherwise,  there  is  at  least  one  entry  in  the  constant  column  of  ^  which  is  neg¬ 
ative.  Choose  an  i  with 
o 


Then  consider  the  row  of  T^_  ^  which  is  headed  by  x.  .  If  this  row  contains  no 

positive  entry,  then  our  given  problem  has  no  solution. 0  Otherwise,  consider  the 

columns  /?.  of  T.  ,  such  that 
J  k- 1 


and  select  from  these  a  column 


b.  .  >  0 

VJ 


of  T, 


k  - 1 


such  that 


o 


< 


for  every  j  satisfying  b(  \  >  0  .  Thus,  we  have  obtained  the  pivot  element  b;  t 

yo »  J  O’ 

In  numerical  computations,  the  pivot  element  is  usually  marked  by  a  circle  around 

the  numerical  entry  in  the  tableau  Tj  ^  ■ 
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Having  chosen  the  pivot  element  k  i  in  the  tableau  T,  n  ,  we  can  construct  the 

lo’  Jo  K 

next  tableau  T,  as  follows: 
k 


First,  change  the  nonbasic  variable  u,  into  x,  .  Thus,  we  obtain  the  nonbasic 
variables  v^,  •••,  v  given  by 


V< 


u. 

J 


xi  > 
o 


(if  i  ^  i0) 


(if  j  =  j0)  • 


Next,  the  column  y*  in  T,  headed  by  V;  =  x,-  is  obtained  by  dividing  j5  4  by 
j0  k  Jo  xo  jo 


the  pivot  element  k  ,  ;  in  symbols, 

o’m 


= 


■*°  ^i  , j 
o  o 


Next,  the  constant  coliunn  yQ  in  is  obtained  from  PQ  by  subtracting  bj  ,  o  T  j  ; 
in  symbols, 

y  =  P  -  b.  n  y . 

'  O  *0  1  .o  '  ] 

0  o 

Since  b^  o  is  negative,  we  actually  have 

y  =  P  +  (-  b.  n  }  y . 

0  o  V  v°  \ 


Finally,  the  column  y .  in  headed  by  w  =  m  ,  (j^jQ),  is  obtained  from  p  ^  by 

subtracting  b;  4  y;  ;  in  symbols, 
o’ J  ■’o 

y  .  =  p  .  -  b .  .  y . 

J  3  Vi  ]o 

This  completes  the  construction  of  Tj  . 
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Section  5 

AN  ILLUSTRATIVE  EXAMPLE 


In  the  present  section,  let  us  study  the  standard  minimum  problem  of  finding  non¬ 
negative  real  numbers 

f  f  f  f  f  f 

*T  2’  V  V  V  6 

which  minimize  a  given  linear  function 

y  =  t-  +  t„  +  t„  +  t .  +  t  +  t 
12  2  4  5  0 


subject  to  a  system  of  10  linear  inequalities 


V 


tc  >  0 
o  - 


fc6  ”  tl  “ 


t4>  0 


*"6  ~  t2 


t3>° 


tl  +  t2  +  t3  -  t6  -  1  ^  ° 

t2  +  t4-t6-1^° 

t-  +  t-  -  tfi  -  1  >  0 
15b  - 


*2 


t^  0 


^2  =  0 


V 


t3>=o 


V 


t4i  o 


Introduce  slack  variables  x.,  (1  <  i  <  10),  for  the  left  members  of  the  inequalities. 
Thus,  the  given  problem  is  reduced  to  find  the  minimum  value  of  the  variable  y 
subject  to  the  following  eleven  equations: 
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y 

4i +  h 

+  l3 

+  h 

xi 

=  *6  "  *5 

X2 

-‘4 

X3 

=  t6~t2 

-*3 

X4 

=  h  +  *2 

+  *3 

X5 

=  t2  +  t4 

*6 

-  i 

x6 

=  tl+t5 

'*6 

-  i 

X7 

=  t2“tl 

X8 

=  t3_t2 

X9 

=  t4-t3 

xio 

mt5-U 

and  the  condition  that 

>  0,  (1  <  i  <  10) 

t  >  0,  (1  <  j  <  6)  . 


The  matrix  A  of  the  right  members  of  these  equations  is  as  follows: 


A  = 


0 

0 

0 

0 

-1 

-1 

-1 

0 

0 

0 

0 


1 

0 

-1 

0 

1 

0 

1 

-1 

0 

0 

0 


1 

0 

0 

-1 

1 

1 

0 

1 

-1 

0 

0 


1111 
0  0-11 
0-101 
-10  0  1 

10  0-1 
0  10-1 
0  0  1-1 

0  0  0  0 

10  0  0 

-110  0 
0-110 
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Since  ail  coefficients  of  the  linear  function  y  are  positive,  the  problem  is  dually 
feasible.  Let 


X10  +  j  tj  ’ 


(1  5  j  <  6)  . 


Then  we  obtain  the  initial  tableau  T  as  follows: 

o 


Const. 

. 

*1 

*2 

*3 

*4 

*6 

*6 

y 

0 

1 

1 

1 

1 

1 

1 

xi 

0 

0 

0 

0 

0 

-1 

1 

X2 

0 

-1 

0 

0 

-1 

0 

1 

X3 

0 

0 

-1 

-1 

0 

0 

1 

X4 

-1 

© 

1 

1 

0 

0 

-1 

X- 

0 

-1 

0 

1 

0 

1 

0 

-1 

X6 

-1 

1 

0 

0 

0 

1 

-1 

X7 

0 

-1 

1 

0 

0 

0 

0 

X8 

0 

0 

-1 

1 

0 

0 

0 

X9 

0 

0 

0 

-1 

1 

0 

0 

X10 

0 

0 

0 

0 

-1 

1 

0 

*1 

0 

1 

0 

0 

0 

0 

0 

*2 

0 

.  .. 

0 

1 

0 

0 

0 

0 

*3 

0 

0 

0 

1 

0 

0 

0 

*4 

0 

0 

0 

0 

1 

. 

0 

0 

*5 

0 

0 

0 

0 

0 

1 

0 

*6 

0 

0 

0 

0 

0 

0 

1 
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The  constant  column  contains  3  negative  entries  in  the  rows  headed  by  x^,  x,.  and 
Xg  .  Each  of  these  rows  contains  some  positive  entries.  Let  us  choose  the  row 
headed  by  x^  .  This  row  contains  3  positive  entries  in  the  columns  headed  by  t- , 
tg,  and  tg  .  Of  these  3  columns,  the  one  headed  by  t^  is  the  least  in  the  lexico¬ 
graphical  order  and  hence  (3. 16)  is  satisfied.  Therefore,  we  have  to  choose  the 
element  1  located  in  the  row  headed  by  x^  and  in  the  column  headed  by  t^  as  the 
pivot  element  for  the  construction  of  the  next  tableau  T^  . 

Thus,  we  indicate  the  pivot  element  in  Tq  by  a  circle  around  it.  Then,  by  following 
the  process  of  constructing  Tk  from  T^_  1  described  in  Section  4,  we  obtain  our 
next  tableau  T-  ,  listed  as  follows: 


Const. 

X4 

*2 

*3 

'*4 

*5 

*6 

y 

1 

1 

0 

0 

1 

1 

2 

xi 

0 

0 

0 

0 

0 

-1 

1 

x2 

-1 

-1 

1 

© 

-1 

0 

0 

X3 

0 

0 

-1 

-1 

0 

0 

1 

X4 

0 

1 

0 

0 

0 

0 

0 

X5 

-1 

0 

1 

0 

1 

0 

-1 

X6 

0 

1 

-1 

-1 

0 

1 

0 

x? 

-1 

-1 

2 

1 

0 

0 

-1 

X8 

0 

0 

-1 

1 

0 

0 

0 

x9 

0 

0 

0 

-1 

1 

0 

0 

x10 

0 

0 

0 

0 

-1 

1 

0 

tl 

1 

1 

-1 

-1 

0 

0 

1 

t2 

0 

0 

1 

0 

0 

0 

0 

*3 

0 

0 

0 

1 

0 

0 

0 

*4 

0 

0 

0 

0 

1 

0 

0 

*5 

o 

0 

0 

0 

0 

1 

0 

*6 

0 

0 

0 

0 

0 

0 

1 
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The  constant  column  of  T  ^  contains  3  negative  entries  in  the  rows  headed  by  x^, 
Xj.  and  x^  .  Let  us  choose  x 2  .  Then,  by  (3.  16),  the  pivot  element  is  in  the  col¬ 
umn  headed  by  tg  .  Hence,  we  obtain  the  next  tableau  Tg  as  follows: 


■ 

Const. 

X4 

*2 

X2 

*6 

H 

B 

0 

0 

B 

fl 

xi 

0 

0 

0 

0 

0 

B 

B 

X2 

° 

0 

0 

1 

0 

0 

0 

X3 

|  | 

B 

0 

-1 

B 

0 

<D 

X4 

0 

i 

0 

0 

0 

0 

0 

X5 

mm 

0 

1 

0 

1 

0 

-1 

X6 

-i 

0 

0 

B 

B 

B 

0 

X7 

0 

0 

1 

i 

B 

0 

-1 

x8 

■fl 

1 

-2 

i 

B 

0 

0 

X9 

-1 

-1 

B 

fl 

0 

0 

0 

X10 

0 

0 

0 

0 

B 

B 

0 

a 

0 

0 

0 

B 

B 

0 

1 

*2 

0 

0 

1 

0 

0 

0 

0 

*S 

1 

B 

B 

B 

B 

0 

0 

*4 

0 

0 

0 

0 

i 

0 

0 

*5 

0 

0 

0 

0 

0 

1 

0 

t6 

0 

0 

0 

0 

0 

0 

1 

The  constant  column  of  Tg  contains  4  negative  entries  in  the  rows  headed  by  Xg, 

Xg,  Xg  and  x^  .  Let  us  choose  Xg  .  Then  the  pivot  element  is  in  the  column  headed 
by  tg  .  Thus,  we  obtain: 
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Const. 

X4 

^2 

X2 

*4 

X3 

y 

3 

3 

0 

2 

3 

1 

2 

xi 

1 

1 

0 

1 

1 

-1 

1 

X2 

0 

0 

0 

1 

0 

0 

0 

X3 

0 

0 

0 

0 

0 

0 

1 

X4 

0 

1 

0 

0 

0 

0 

0 

X5 

-2 

-1 

© 

-1 

0 

0 

-1 

X6 

-1 

0 

0 

-1 

-1 

1 

0 

X7 

-1 

-1 

1 

0 

0 

0 

-1 

X8 

1 

1 

-2 

1 

1 

0 

0 

X9 

-1 

-1 

1 

-1 

0 

0 

0 

X10 

0 

0 

0 

0 

-1 

1 

0 

*1 

1 

1 

0 

0 

0 

0 

1 

^2 

0 

0 

1 

0 

0 

0 

0 

*3 

1 

1 

-1 

1 

1 

0 

0 

*4 

0 

0 

0 

0 

1 

0 

0 

*5 

0 

0 

0 

0 

0 

1 

0 

*6 

1 

1 

0 

1 

1 

0 

1 

The  constant  column  of  Tg  contains  4  negative  entries  in  the  rows  headed  by  x,., 
Xg,  x?,  and  .  Let  us  choose  x,_  .  Then  the  pivot  element  is  in  the  column 
headed  by  t2  .  Thus  we  obtain: 
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Const. 

X4 

X5 

X2 

l4 

*5 

X3 

y 

3 

3 

0 

2 

3 

1 

2 

xi 

1 

1 

0 

1 

1 

-1 

1 

X2 

0 

0 

0 

1 

0 

0 

0 

X3 

0 

0 

0 

0 

0 

0 

1 

X4 

0 

1 

0 

0 

0 

0 

0 

X5 

0 

0 

1 

0 

0 

0 

0 

X6 

-1 

0 

0 

-1 

-1 

© 

0 

X7 

1 

0 

1 

1 

0 

0 

0 

X8 

-3 

-1 

-2 

-1 

1 

0 

-2 

X9 

1 

0 

1 

0 

0 

0 

1 

X10 

0 

0 

0 

0 

-1 

1 

0 

*1 

1 

1 

0 

0 

0 

0 

1 

*2 

2 

1 

1 

1 

0 

0 

1 

*3 

-1 

0 

-1 

0 

1 

0 

-1 

*4 

0 

0 

0 

0 

1 

0 

0 

*5 

0 

0 

0 

0 

0 

1 

JL 

0 

*6 

1 

_ 

1 

_ 

0 

1 

1 

0 

1 

The  constant  column  of  contains  3  negative  entries  in  the  rows  headed  by  Xg , 

xn  and  t„  .  Let  us  choose  x.  .  Then  the  pivot  element  is  in  the  column  headed  by 
o  o  b 

tr  .  Thus  we  obtain: 
o 
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The  constant  column  of  IT  contains  2  negative  entries  in  the  rows  headed  by  Xg 
and  tg  .  Let  us  choose  xg  .  Then  the  pivot  element  is  in  the  column  headed  by  t^  . 
Thus  we  obtain: 
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Const. 

X4 

X5 

X2 

X8 

X6 

X3 

y 

16 

7 

. 

8 

7 

4 

1 

10 

xi 

0 

i 

0 

0 

0 

-1 

1 

X2 

0 

0 

0 

1 

0 

0 

0 

X3 

o 

0 

0 

0 

0 

0 

1 

x4 

0 

i 

0 

0 

0 

0 

0 

X5 

0 

0 

1 

0 

0 

0 

0 

X6 

0 

0 

0 

0 

0 

1 

0 

X7 

1 

0 

1 

1 

0 

0 

0 

X8 

0 

0 

0 

0 

1 

0 

0 

X9 

1 

0 

1 

0 

0 

- 

0 

1 

X10 

1 

0 

0 

1 

0 

1 

0 

*! 

1 

1 

0 

0 

0 

0 

1 

*2 

2 

1 

1 

1 

0 

0 

1 

*3 

2 

1 

1 

1 

1 

0 

1 

*4 

3 

1 

2 

1 

1 

0 

2 

*5 

4 

1 

2 

2 

1 

.1 

2 

*6 

4 

2 

2 

2 

1 

0 

3 

Since  the  constant  column  of  contains  no  negative  entry,  we  obtain  an  optimal 
solution  of  our  problem;  namely,  the  minimum  value  of  the  linear  function 

y  =  tl  +  t2  +  t3  +  t4  +  t5  +  t6 
subject  to  the  given  constraints  is 

y  =  16 
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reached  when 


V4 

V4- 


This  completes  the  illustrative  example. 

In  the  preceding  example,  we  have  always  chosen  the  first  negative  entry,  counting 
from  top  down  next  to  the  y  row,  in  the  constant  column  of  the  tableaux.  For  definite¬ 
ness,  one  can  make  this  a  rule  in  practice  especially  when  programming  to  electronic 
computers. 
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Section  6 

SWITCHING  FUNCTIONS 


Let  Q  denote  the  set  which  consists  of  the  two  integers  0  and  1  .  For  any  given 
integer  n  £  1  ,  consider  the  Cartesian  power 

Qn  = Qx  .  . .  xQ 

which  is  the  Cartesian  product  of  n  copies  of  Q  .  Thus,  the  elements  of  Qn  are 
the  2n  ordered  n-tuples 

(xl>  X2’  ‘  ‘ ’  xn) 

where  the  k-th  coordinate  x^  is  in  Q  for  every  k  =  1,  2,  .  . .  ,  n.  Hereafter,  Qn 
will  be  called  the  n-cube  and  its  2n  elements  will  be  called  its  points. 


By  a  switching  function  (or  truth  function  or  Boolean  function)  of  n  variables,  we 
mean  any  subset  F  of  the  n-cube  Qn  .  Since  Qn  has  2n  points,  there  are  22° 
different  switching  functions  of  n  variables. 


A  switching  function  F  of  n  variables  is  said  to  be  linearly  separable  provided  that 

there  exist  n+1  real  numbers  w1,  w  ,  ...,  w  ,  w  ,  such  that,  for  every  point 

l  o  n  11+  x 

x  =  (Xj,  . . .  ,  xfi)  in  Q  1  ,  we  have  xeF  if  and  only  if 


W1  X1  +  W2  X2  +  ' 


+  w  x  <  w  ,  ..  . 
n  n  -  n+1 


The  set  w  =  (w^,  w2, 
numbers  w^,  w 2>  . . 


there  exists  a  point  x  =  (x^,  . . . ,  xj  in  F  such  that 


■  •  ,  wn,  w  .j)  is  called  a  separating  system  of  F  ;  the  real 
wn  are  called  the  weights ,  and  the  real  number  wn+^  is 
called  the  threshold.  By  talcing  the  threshold  w  -  as  small  as  possible  while  the 
weights  Wp  . . . ,  w  are  held  fixed,  we  may  assume  that,  in  case  F  is  not  empty, 

h> 


W1  X1  +  W2  X2  + 


+  W  X  =  w  ,  - 
n  n  n+1 


6-1 


LOCKHEED  MISSILES  &  SPACE  COMPANY 


6-90-62-118 


Consider  the  complement  F '  =  Qn  - F  of  F  .  For  every  point  y  =  (y^,  . . .  ,  y  )  in 
F'  ,  we  have 


wi  yi +  w2  y2  -1-  • 


+  w  y  >  w  ,  . 
n  n  n+1 


Let  M  denote  the  minimal  value  of 


w,  y..  +  w_  yn  +  . . .  +  w  y  -  w  , 

1  J1  2  J2  nJn  n+1 

for  all  points  y  =  (y^,  y  )  in  F'  incase  F'  is  not  empty.  This  positive  real 
number  M  is  called  the  margin  of  the  separating  system  W  (Ref.  8,  p.  6).  A  sep¬ 
arating  system  W  =  (w  ,  . . . ,  w  j)  of  F  is  said  to  be  normal  provided  that  M  =  1  . 
Every  separating  system  W  of  F  can  be  normalized  by  dividing  each  w.  ,  (i  =  1,  2, 
.  .  . ,  n+1),  by  the  margin  M  of  W  .  In  particular,  every  linearly  separable  switch¬ 
ing  function  F  has  a  normal  separating  system. 


Let  W  =  (w  1,  . . . ,  w  be  any  normal  separating  system  of  a  given  linearly  separa¬ 
ble  switching  function  F  of  n  variables.  Then,  for  every  point 

x  =  C  x1,  . . . ,  xn  j  e  Qn 

we  have: 


wi  xi  +  •  • 

.  +  W  X  <  w  ,  ,, 
n  n  -  n+1 

(if  xeF) 

wixi+-- 

.  +  w  x  >  w  ,  + 
n  n-  n+1 

- 1,  (if  xeF') 

By  a  canonical  switching  function  of  n  variables,  we  mean  a  linearly  separable 
switching  function  F  of  n  variables  which  admits  a  separating  system  W  =  (w^, 

•  ’  '  ’  Wn’  Wn+1)  satisfTinS 

0  <  w,  <  w„  <  . . .  <  w  . 

-  1  -  2  -  =  n 

In  words,  the  weights  w1,  w . w  in  W  are  nonnegative  and  nondecreasing. 

i  o  n 
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It  is  well-known  (Refs.  9  and  10)  that  every  linearly  separable  switching  function  F 
of  n  variables  can  be  reduced  to  a  unique  canonical  switching  function  by  permuting 
and  complementing  a  number  of  the  variables. 

By  a  weight  function  of  n  variables,  we  mean  a  homogenous  linear  function 

w  :  Rn  -  R 

on  the  n-dimensional  Euclidean  space  Rn  with  real  values.  Precisely,  there  are 
n  real  numbers  w^,  .  . .  ,  such  that,  for  an  arbitrary  point  x  =  (x^,  .  . .  ,  x  )  of 
Rn ,  we  have 

w(x)  =  w,  x„  +  . . .  +  w  X  . 

'  '  11  n  n 

The  real  numbers  w^,  .  .  . ,  w^  are  called  the  coefficients  of  the  weight  function  w  . 

A  weight  function  w  :  Rn  ->  R  with  coefficients  w^ . w^  is  said  to  be  canonical 

provided 

0  <  w  <  w.  <  . . .  <  w  . 

-1=2=  =  n 

By  means  of  the  canonical  weight  functions  of  n  variables,  we  can  define  a  partial 
order  in  the  n-cube  Qn  as  follows:  Let  x  =  (x^,  . .  . ,  x  )  and  y  =  (y^,  .  . .  ,  y  )  be 
any  two  points  of  Qn  ;  then  we  define  x  <  y  if  and  only  if  w(x)  g  w(y)  for  every 
canonical  weight  function  w  of  variables.  This  partial  order  in  Qn  is  called  the 
canonical  partial  order  (Ref.  10) . 

Using  the  canonical  partial  order  g  in  the  n-cube,  we  can  define  the  regular  switching 
functions  as  follows:  a  switching  function  F  of  n  variables  is  said  to  be  regular  if 
and  only  if  it  satisfies  the  regularity  condition: 

If  xeF  and  y  <  x ,  then  yeF  . 

Obviously,  every  canonical  switching  function  of  n  variables  is  regular.  In  Ref.  11, 
it  was  proved  that  every  regular  switching  function  of  n  g  5  variables  is  canonical; 
in  Ref.  12,  an  example  is  given  which  shows  that  not  every  regular  switching  function 
is  canonical. 
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Section  7 

SYNTHESIS  AND  MINIMIZATION 


Let  F  be  an  arbitrary  switching  function  of  n  variables.  The  synthesis  problem  for 
the  linear  separability  of  F  is  to  determine  whether  or  not  F  is  linearly  separable 
and  to  find  a  separating  system  (w^,  . .  . ,  wn>  wn+^)  for  F  in  case  F  in  linearly 
separable. 

Among  various  synthesis  methods  for  linear  separability  introduced  in  the  literature, 
the  one  given  by  D.  G.  Willis  (Ref.  4),  turns  out  to  be  the  most  convenient  because  it 
involves  as  few  linear  inequalities  as  possible.  In  Ref.  4,  the  synthesis  problem  for 
the  linear  separability  of  arbitrary  switching  functions  of  n  variables  was  reduced  to 
that  of  the  regular  switching  functions  of  n  variables.  Indeed,  it  remains  to  determine 
whether  or  not  a  given  regular  switching  function  F  is  linearly  separable  and  to  find 
a  canonical  separating  system  (w^,  ...,  wfi,  wn+  j)  f°r  F  incase  F  is  linearly 
separable  and  hence  canonical. 

For  the  convenience  of  the  reader,  we  describe  briefly  the  Willis  synthesis  method 
as  follows: 

Let  F  be  an  arbitrary  nonempty  regular  switching  function  of  n  variables  as  defined 
in  Section  6.  Let  L  denote  the  set  of  all  maximal  points  of  F  with  respect  to  the 
canonical  partial  order  in  the  n-cube  Qn;  and  let  M  denote  the  set  of  all  minimal 
points  of  the  complement  F'  =  Qn  -  F  with  respect  to  the  same  canonical  partial  order 
in  Qn.  Let 

ai  =  t11’  '  •  •  ’  ain)  ’  (*  =  h  2 . X) 

be  the  points  of  L  and 
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be  the  points  of  M.  Consider  the  following  system  of  linear  inequalities: 

n 

2  aikwk=wn+r  <i  =  1>  2>  •••'*■> 
k  =  l 

n 

2  V  Wk=  wn4l+1’  0  =1>  2 . ")  ' 

k  =  1 

0  <  w,  <  wr  <  ...  <  w 
=  1=2=  =  n 


(7.1) 


Then,  the  Willis  synthesis  theorem  states  that  the  given  regular  switching  function 

F  is  linearly  separable  if  and  only  if  the  system  (7. 1)  of  linear  inequalities  has  a 

solution  (and  hence  an  integral  solution)  in  w, . w  and  w  . 

i  n  n+  i 


In  Ref.  13,  the  system  (7.  1)  was  solved  by  Fan's  principle  of  bounding  solutions.  An 
elimination  process  for  solving  the  system  (7. 1)  was  formulated  in  Ref.  14,  and  meth¬ 
ods  of  successive  approximation  were  applied  to  solve  (7.1)  in  Ref.  15.  Finally,  the 
simplex  method  in  linear  programming  was  used  in  finding  a  solution  of  the  system 
(7.  1)  in  Ref.  3. 


The  next  problem  is  naturally  the  minimization  problem  which  is  to  find  the  most 
economical  solution  of  the  system  (7.  1)  in  case  the  given  regular  switching  function 
F  is  linearly  separable.  In  other  words,  the  minimization  problem  is  to  find  a 
solution 


of  the  system  (7.  1)  which  makes  some  cost  function 

0  ( W.. ,  ...,W,  W  .A 

V,  1  n  n+1  J 

minimal.  The  precise  formulation  of  the  problem  is  as  follows: 


7-2 


LOCKHEED  MISSILES  &  SPACE  COMPANY 


6-90-62-118 


First,  let  us  pick  the  cost  function  0  .  Assume  that  the  cost  of  realizing  the  w.  , 

(i  =  1,  2,  .  ,  n,  n+1),  is  proportional  to  the  magnitude  of  w.  .  Under  this  assump¬ 

tion,  the  cost  function  0  will  be  a  homogeneous  linear  function 

n+1 

0(wr  ....  wn+^  =  YjW.  (7.2) 

i  =  1 

where  the  coefficients  y^  ,  . . .  ,  Yn+j  are  nonnegative  real  numbers.  In  the  literature, 

(see  Ref.  16),  two  different  cost  functions  have  been  studied;  one  of  these  is  defined 

by  y .  =  1  for  all  i  =  1,  2,  . . .  ,  n+1  and  the  other  is  given  by  Yi  =  1  for  all  i  <  n 

and  y  , ,  =  0. 
n+1 


Having  fixed  the  cost  function  <p  by  (7.  2),  the  minimization  problem  for  the  given 
regular  switching  function  F  is  that  of  finding  a  canonical  normal  separating  system 
which  minimizes  0  ;  in  other  words,  nonnegative  real  numbers 


wl’  W2’  V  Wn+1 


are  to  be  determined  which  minimize  the  cost  function  (7.  2)  and  satisfy  the  system 
(7. 1)  of  linear  inequalities. 


Next,  let  us  write  the  system  (7. 1)  of  linear  inequalities  in  the  form  of  (2.  2).  Thus, 
the  first  A  linear  inequalities  become 

n 

'  2  aik  Wk  +  Wn+1  =  °’  (i  =  2 . A) '  (7‘  3) 

k  =  1 

The  next  p  linear  inequalities  of  (7.1)  become 


1  +  2-J  bjk  Wk  ~  Wn+1  -  °’ 
k  =  l 


(j  —  1,  2,  . . . ,  p) 


(7.4) 
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Under  the  condition  that  the  variables  w^,  . . . ,  are  nonnegative,  the  remaining 

inequalities  in  (7.  1)  are  equivalent  to  following  n-1  linear  inequalities: 

Wk  ~  wk-l  =  °’  (k  =  2,  3,  . . . ,  n).  (7.  5) 

Consequently,  the  minimization  problem  for  the  given  regular  switching  function  F 
is  a  standard  minimization  problem  in  linear  programming  of  finding  q  =  n+  1  non¬ 
negative  real  numbers 

^  1  2’  ’  n  n+1 ) 

which  minimize  the  linear  cost  function  (7.  2)  and  also  satisfy  the  system  of  p=\  + 
p  +  n  -  1  linear  inequalities  (7. 3),  (7.  4),  and  (7.  5). 
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Section  8 

SOLUTION  OF  THE  MINIMIZATION  PROBLEM 


In  Section  7,  we  have  seen  that  the  minimization  problem  for  a  given  regular  switching 
function  F  is  a  standard  minimization  problem  in  linear  programming.  In  the  pre¬ 
sent  section,  we  are  concerned  with  the  methods  of  solving  this  problem.  For  this 
purpose,  we  assume  that  the  first  n  coefficients  in  the  cost  function  (7.  2)  are  posi¬ 
tive;  in  symbols, 

y.  >  0,  (i=l,  2 . n).  (8.1) 

Economically,  this  means  that  it  costs  something  to  realize  the  weights  w^,  . . . ,  wn 
physically.  For  the  two  different  cost  functions  studied  in  Ref.  16,  =  1  for  all 

i  =  1,  2,  . . , ,  n.  Hence,  the  condition  (8.  1)  is  rather  reasonable. 

Let  us  briefly  review  some  standard  terminology  in  linear  programming.  By  a 
feasible  solution  of  the  minimization  problem  for  F  ,  we  mean  a  set  of  n+  1  non¬ 
negative  real  numbers 

(V  W2’  •••’  V  Wn+l) 

which  satisfy  the  linear  inequalities  (7.  3),  (7.  4),  and  (7.  5).  By  an  optimal  solution 
of  the  problem,  we  mean  a  feasible  solution  which  minimizes  the  cost  function  (7.  2). 

The  minimization  problem  for  F  is  said  to  be  feasible  provided  that  it  has  a  feasible 
solution.  Hence,  the  problem  is  feasible  if  and  only  if  the  given  regular  switching 
function  F  is  linearly  separable. 

Furthermore,  for  the  nontrivial  case  where  F  is  nonempty  and  different  from  the 
whole  n-cube,  it  was  proved  in  Ref.  5  that  the  minimization  problem  for  F  has  opti¬ 
mal  solutions  if  and  only  if  it  is  feasible.  Hence  every  linearly  separable  regular 
switching  function  F  of  n  variables  has  a  minimal  canonical  normal  separating 
system. 
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As  to  methods  of  solving  the  minimization  problem  for  a  given  regular  switching 
function  F  of  n  variables,  we  certainly  think  of  the  usual  simplex  method  in  linear 
programming.  This  method  splits  into  two  parts  of  work.  The  first  part  is  the  search 
of  a  feasible  solution  of  the  problem  as  in  Ref.  3;  and  the  second  part  is  the  applica¬ 
tion  of  the  simplex  technique  to  find  an  optimal  solution  starting  from  the  feasible 
solution  found  in  the  first  part.  Because  of  this,  the  usual  simplex  method  is  rather 
inefficient  for  this  particular  minimization  problem. 

On  the  other  hand,  the  dual  simplex  method  described  in  Section  3  suits  especially 
well  for  solving  our  particular  standard  minimization  problem.  Indeed,  under  the 
reasonable  assumption  (8.  1),  the  minimization  problem  for  any  nonempty  regular 
switching  function  F  of  n  variables  is  always  dually  feasible  as  defined  in  Section  2. 
Hence,  we  can  apply  the  dual  simplex  method  to  our  problem  right  away. 

As  an  illustrative  example,  let  us  consider  the  regular  switching  function 

F  =  531 


of  five  variables  in  the  notation  introduced  in  Refs. 

5 

sists  of  the  following  ten  points  of  Q  : 

12  and  17.  Precisely,  F  con- 

(0,  0,  0,  0,  0) 

(0, 

0, 

0,  0,  1) 

(1,  0,  0,  0,  0) 

(1. 

1, 

0,  0,  0) 

(0,  1,  0,  0,  0) 

(1, 

o. 

1,  0,  0) 

(0,  0,  1,  0,  0) 

(1, 

0, 

0,  1,  0)  - 

(0,  0,  0,  1,  0) 

(0, 

1, 

1,  0,  0)  . 

The  maximal  points  of  F  can  be  read  from  its  label  531  in  accordance  with  Ref.  12. 
In  fact,  F  has  three  maximal  points,  namely, 

(0,  0,  0,  0,  1) 

(1,  0,  0,  1,  0) 

(0,  1,  1,  0,  0)  . 
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To  find  the  minimal  points  of  the  complement  F'  of  F  ,  we  may  first  find  the  dual 
F*  of  F  defined  in  Ref.  18.  According  to  the  table  at  the  end  of  Ref.  18,  the  dual 
of  F  =  531  is 

F*  = 54321/32/1 

in  the  notation  of  Ref.  17.  By  the  table  given  at  the  end  of  Ref.  12,  the  regular 
switching  function  F*  has  three  maximal  points,  namely, 

(0,  0,  0,  1,  1) 

(1,  0,  1,  0,  1) 

(0,  1,  1,  1,  0)  . 


By  Theorem  5.  1  in  Ref.  18,  it  follows  immediately  that  the  complement  F'  of  F 
has  three  minimal  points,  namely, 

(1,  1,  1,  0,  0) 

(0,  1,  0,  1,  0) 

(1,  0,  0,  0,  1)  . 


Having  obtained  the  maximal  points  of  F  and  the  minimal  points  of  its  complement 
F'  ,  we  can  exhibit  the  system  of  inequalities  (7.  3),  (7.  4)  and  (7.  5)  in  the  form  of 
the  following  ten  linear  inequalities: 


w„  - 

w,.  >  0 

6 

5  = 

w_  - 

w.,  - 

w .  >  0 

6 

1 

4  = 

w„  - 

w~  - 

w_  >  0 

6 

2 

5  = 

+  w„  +  w_ 

-  w„ 

-  i  ;>  ° 

2  3 

6 

w„  +  w. 

- 

-  1>  0 

2  4 

6 

w,  +  w,. 

-  w. 

-  1  >  0 

1  5 

6 

W2 

w2  =  o 

w0  - 

w„  >  0 

3 

2  = 

w4  -  Wg  2:  0 

wc  -  w.  >  0 
5  4  = 


8-3 


LOCKHEED  MISSILES  &  SPACE  COMPANY 


6-90-62-118 


Next,  for  the  definiteness,  let  us  choose  the  cost  function  to  be  the  linear  function 

y  =  +  w2  +  Wg  +  +  Wg  +  Wg  . 


Thus,  we  obtain  exactly  the  illustrative  example  in  Section  5  as  our  standard  minimum 
problem.  Hence,  the  given  regular  switching  function  F  =  531  has  a  minimal  nor¬ 
mal  canonical  separating  system 

(wl>  w2’  w3’  W4’  W5’  we) 

with 
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